33 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office euro pee n des brevets 



(12) 



(H) EP 1 148 687 A1 

EUROPEAN PATENT APPLICATION 



(43) Dale of publication: 

24.10.2001 Bulletin 2001/43 

(21) Application number: 00108037.3 

(22) Dale of filing: 20.04.2000 



(51) Intci7: H04L 29/06 



(84) Designated Contracting States: 


(72) 


Inventors: 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• 


Hameleers, Heino 


MC NL PT SE 




6471 VN Kerkrade (NL) 


Designated Extension States: 


• 


Hundscheidt, Frank 


AL LT LV MK RO SI 




6463 BK Kerkrade (NL) 


(71 ) Applicant: Telefonaktiebolaget L M Ericsson 


(74) 


Representative: HOFFMANN r EITLE 


(Pub!) 




Patent- und Rechtsanwalte 


126 25 Stockholm (SE) 




Arabellastrasse 4 






81925 Munchen (DE) 



(54) Communication device 

(57) A communication device and method of distrib- 
uting data over a plurality of channels is described, 
where a first protocol implementation (11) provided at a 
first layer (1) has a plurality of media data streams (12, 
13,14). each media stream being associated with a type 
of media, and passes the streams to a lower layer (2). 
The lower layer (2) comprises a second protocol imple- 



mentation that is operable to identify the media data 
streams. In a third layer (3) channels (31, 32) are pro- 
vided that may be associated with different qualities of 
service. The second protocol implementation is also op- 
erable to perform the placing of a given media stream 
into a given channel on the basis of the type of media 
in the given media stream and the quality of service as- 
sociated with the given channel. 
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Description 

[Field of the Invention] 

[0001 ] The present invention relates to a communica- 
tion device and a method for distributing data over a plu- 
rality of channels. 

[Background of the Invention and Prior Art] 

[0002] Communication devices and a protocol archi- 
tecture for the sending and receiving of multi-media in- 
formation are known. For example, ITU-T Recommen- 
dation H.324 (03/96) describes the protocol architecture 
and basic arrangement of terminals that are suitable for 
low bit rate multi-media communication, and ITU-T Rec- 
ommendation H.323 (11/96) describes visual telephone 
systems and equipment for local area networks with a 
non-guaranteed quality of service. Both of these docu- 
ments are herewith incorporated by reference. 
[0003] Figure 5 shows a basic arrangement of a multi- 
media terminal 7 as described in ITU-T Recommenda- 
tion H.324. The terminal 7 is connected to a general 
switched telephone network (GSTN) 90 and comprises 
a video I/O- unit 71 , an audio l/O-unit 72 and a user data 
application 73. In other words, the terminal 7 is capable 
of handling three types of media, namely video, audio 
and data. The corresponding data from units 71 , 72 and 
73 is fed to a video codec 75, an audio codec 76 and a 
data protocol unit 77, respectively. Then the three media 
streams are fed to a multiplexer/demultiplexer 79, which 
multiplexes the media streams into a single bit stream. 
This single bit stream is then passed to a modem 80, 
which suitably converts the bit stream for transportation 
over the GSTN network 90. 

[0004] In the opposite direction, the multiplexer/de- 
multiplexer 79 demultiplexes data received by the mo- 
dem 80 out of network 90, and feeds the demultiplexed 
streams into the appropriate codecs or units, which in 
turn process and pass them to the appropriate I/O unit 
or application. 

[0005] The terminal 7 is controlled by a system con- 
troller 74, where said system controller 74 provides con- 
trol commands for the control protocol unit 78 and the 
modem control 81 . The control protocol of unit 78 man- 
ages the logical channels used to transport the-media - 
streams. For example, the selected control protocol can 
be the one described in ITU-T Recommendation H.245 
(03/96), which is herewith incorporated by reference. 
The multiplexing and demultiplexing in unit 79 can e.g. 
be done in accordance with ITU-T Recommendation H. 
223 (03/96), which is herewith also incorporated by ref- 
erence. Some aspects of H.245 and H.223 will be ex- 
plained in more detail later with reference to the example 
of Fig. 7. 

[0006] The multipoint control unit (MCU) 91 is a part 
of the GSTN network 90 and serves to control multi-me- 
dia sessions between a plurality of multi-media termi- 



nals 7. This is well known in the art and needs not be 
explained in more detail here. 

[0007] On the other hand, communication networks 
are known, which provide the possibility of establishing 

5 multi-links between one terminal and the network. An 
example of such a system is the Universal Mobile Tele- 
phone Standard (UMTS). As a means for distributing da- 
ta onto a varying number of channels or links, ITU-T 
Recommendation H.226 (09/98) describes a channel 

10 aggregation protocol for multi-link operation on circuit- 
switched networks, where the system in accordance 
with recommendation H.226 has the ability to operate 
with a changing number of channels with arbitrary, dif- 
ferent, or continuously varying bit rates, as well as fixed- 

15 rate channels. H.226 has the object of finely distributing 
payload across different channels, simultaneously min- 
imizing latency and overhead. ITU-T Recommendation 
H.226 (09/98) is herewith also incorporated by refer- 
ence. 

20 [0008] The mechanism of H.226 consists in receiving 
a continuous bit stream from a higher layer, dividing the 
bit stream into so-called samples, the size of a sample 
being 8 bits. The samples form a sequence that needs 
to be transported in order to the receiving H.226 peer. 

25 The distributing of samples over given channels (H.226 
is not concerned with how channels are managed, i.e. 
established, maintained or removed) takes into account 
the different transmission rates of each channel. Chan- 
nels having a high transmission rate will receive more 

30 samples than channels having a low transmission rate. 
In other words, the average distance of two consecutive 
samples with respect to their sequence numbering will 
be smaller on a channel having a high transmission rate 
than on a channel having a low transmission rate. In this 

35 way, it is assured that the skew between different chan- 
nels does not exceed a specified limit. 
[0009] Fig. 7 shows an example, where the above 
concepts are combined. Namely, an application 701 
provides instructions (e.g. mode setting commands) to 

40 a control protocol implementation (e.g. H.245), and pro- 
vides data information to a data protocol implementation 
706. It may be noted that Fig. 7 shows a protocol hier- 
archy, and application 701 of Fig. 7 corresponds to ele- 
ments 73 and 74 of Fig. 5, while control protocol imple- 

45 mentation 704 corresponds to element 78, and data pro- 
. tocol 706 corresponds to data protocol 77. The control 
protocol implementation 704 provides data to an LAPM 
(Link Access Procedure for Modems) 705. Otherwise an 
audio I/O 702, video I/O 703, audio coder 707 and video 

50 coder 708 are provided, which all respectively corre- 
spond to elements 72, 71 , 76, 75 of Fig. 5. 
[0010] Reference numeral 709 indicates a multiplex- 
ing protocol implementation, e.g. according to H.223 
(see also element 79 in Fig. 5). In the example of Fig. 7 

55 the multiplexing layer receives four distinct logical chan- 
nels LCh1 (control), LCh2 (data), LCh3 (audio) and 
LCh4 (video). Naturally, a larger or smaller number of 
logical channels is possible. H.223 is a packet-oriented 



XXID. <EP 1148687A1_I_> 



2 



3 



EP1 148 687 A1 



4 



multiplexing protocol that is designed to primarily pro- 
vide adaptation and multiplexing. The units of informa- 
tion received by the adaptation function of H.223 are re- 
ferred to as AL-SDUs (Adaptation Layer Service Data 
Unit). This nomenclature is due to the fact that H.223 is 5 
generally considered to consist of an (upper) adaptation 
layer (AL) and a (lower) multiplexing layer (MUX layer). 
The AL_SDUs contain an integer number of octets. The 
adaptation function of the AL consists in adding, where 
appropriate; additional octets for purposes such as error 10 
detection, sequence numbering, and retransmission. 
ITU Recommendation H.223 (03/96) mentions three dif- 
ferent types of ALs, namely AL1, AL2 and AL3, where 
AL1 is designed primarily for the transfer of data or con- 
trol information, AL2 is designed primarily for the trans- « 
f er of digital audio, and AL3 is designed primarily for the 
transfer of digital video. Typically, the specific AL will be 
chosen by the H.245 control protocol 704 using the so- 
called OpenLogicalChannel message at the time a log- 
ical channel is opened (see Recommendation H.245 20 
(03/96)). Any of the three types of AL may be used to 
carry a given logical channel. 

[0011] The adapted data units are called MUX-SDUs, 
and each MUX-SDU always contains an integral 
number of octets that belong to a single logical channel. 25 
The MUX-SDUs are placed into so-called MUX-PDUs 
by the multiplexing layer. MUX-PDUs, which are output 
to the lower lying physical layer(s), consist of a one-octet 
header followed by a variable number of octets in the 
information field. Octets from multiple logical channels 30 
may be present in a single MUX-PDU information field. 
In other words, the MUX-PDUs constitute a channel on- 
to which the logical channels LCh1, LCh2, LCh3 and 
LCh4 are multiplexed. The header octet contains a 4-bit 
Multiple Code (MC) field which specifies, by reference 35 
to a multiplex table entry, the logical channel to which 
each octet in the information field belongs. For example, 
multiplex entry 0 is permanently assigned to the control 
channel, and other multiplex entries are formed by the 
transmitter and are signaled to the far end via the control 40 
channel prior to their use. In other words, this will be 
arranged by the control protocol 78 (Fig. 5) under control 
of the system control 74. 

[001 2] In the example of Fig. 7 it is assumed that the 
MUX-PDUs output by H.223 are transported over a net- *s 
work that provides multi-channel capabilities, i.e. the 
possibility of establishing a plurality of physical channels 
having different characteristics, e.g. different transmis- 
sion rates (The term "physical" relates to the fact that 
these channels are provided at the so-called physical 50 
layer, and does not mean that they must have physical 
substance. In other words, the "physical" channels can 
also be defined in logical terms, i.e. as time slots in a 
TDMA scheme). Reference numeral 711 in Fig. 7 indi- 
cates an implementation for managing a plurality of 55 
physical channels. The multi-call capability in UMTS is 
an example. Implementation 711 manages the physical 
channels. As a means for distributing the H.223 PDUs 



onto the plurality of physical channels, an H.226 imple- 
mentation is provided in the example of Fig. 7. This im- 
plementation operates as explained above, i.e. divides 
the multiplexed stream into samples and evenly distrib- 
utes the samples onto the physical channels provided 
by the multi-channel management implementation 711 
in accordance with the transmission rate of the respec- 
tive physical channels. 

[Object of the Invention] 

[0013] The object of the present invention is to provide 
an improved communication device and an improved 
method of distributing data over a plurality of channels. 

[Summary of the Invention] . 

[0014] This object is solved by the communication de- 
vice of claim 1 and the method of distributing data ac- 
cording to claim 11. Advantageous embodiments are 
described in the dependent claims. 
[0015] The present invention proposes a system that 
transports multi-media streams, where each media 
stream is associated with a certain type, where a type 
identifies one or more kind of media contained in trre *• 
stream (e.g. video, audio or data, or a mixture of these) 
and where the connection to a network can be achieved 
over a plurality of channels that may have different qual- 
ities of service. Examples of a quality of service are the 
presence of ARQ (Automatic Retransmission Re- 
Quest), which ensures transmission of all frames or 
packets over the channel, the provision of a real-time 
function, which means that the channel provides a guar- 
anteed delay, or the provision of a certain type of coding, 
such as enhanced speech coding using the AMR codec. 
In accordance with the present invention, a protocol im- 
plementation is provided at the layer for distributing data 
over the channels, said protocol implementation being 
different from the known protocol H.226 in that it is op- 
erable to identify the media streams of different media 
type in the data stream it receives from a higher layer, 
and is operable to perform the placing of a given media 
stream into a given channel on the basis of the type as- 
sociated with the given media stream and the quality of 
service associated with the given channel. 
[0016] This is shown in a general way in figure 1 . In 
figure 1 reference numeral 1 represents a first layer, in 
which three media streams 12, 13, 14 of different type 
and a multi-media control protocol 11 are present. 
These streams correspond to the logical channels 
shown in Fig. 7. The row of dots on the right side indi- 
cates that a larger number of media streams is possible, 
where the additional media streams could have the 
same type as other media streams (e.g. two or more 
video streams), or additional types of media could be 
present. It may be noted that a type can relate to a plu- 
rality of media kinds, such that one type may e.g. identify 
that audio and video is mixed in one stream. Reference 
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number 2 refers to a data distribution layer, where said 
layer is provided lower than layer 1 . Furthermore, a layer 
3 is provided lower than the data distribution layer 2, 
where said layer 3 comprises a plurality of channels 31 , 
32. which may have different qualities of service. The 
dots at the right hand side again indicate that the two 
depicted channels are only an example, and a larger 
number of channels is possible. The transition of data 
from layer 1 to layer 2, and from layer 2 to layer 3 may 
be direct, or further layers/protocol implementations 
may be provided between layers 1 and 2, and between 
layers 2 and 3. 

[001 7] In accordance with the present invention, the 
protocol implementation at the data distribution layer 2 
is capable of performing an association between the 
type of tne media streams and the quality of service as- 
signed to a given channel. As an example, It is possible 
that an audio or video stream is placed into a real-time 
channel whereas a data stream is placed into an error- 
free channel (e.g. an ARQ channel). Or its is possible 
that an audio stream that forms part of a multimedia ses- 
sion is placed into a channel having a desired optimized 
coding for speech. 

[0018] The concept of a layer-based protocol archi- 
tecture is well known (OSI model). It means that a plu- 
rality of communication protocols are arranged in a hi- 
erarchical structure, where each layer has a specific 
function and may comprise one or more protocol imple- 
mentations. A communication always comprises two 
peers of a protocol, one on the sending side, and one 
on the receiving side. The passing down of data from a 
higher layer to a lower layer on the sending side implies 
that the lower layer embeds the data received from the 
higher layer into protocol data units (PDUs) associated 
with a protocol of the lower layer. Embedding means that 
the higher layer data is encapsulated or segmented into 
the lower layer PDUs. On the receiving side, the oppo- 
site operation occurs, namely the data is desegmented 
or deencapsulated from the lower layer PDUs and 
passed to the higher layer peer. This is well known in 
the art and needs not be explained further. 
[0019] Furthermore, the term "channel" is used ge- 
nerically in the context of the present application and 
shall generally refer to any logical and/or physical ar- 
rangement capable of conveying a bit stream. There- 
fore, the term "channel" as used in the present applica- 
tion also refers to bit-pipes, bearers, carriers, etc. 

[Brief Description of Figures] 

[0020] The features and advantages of the present 
application shall become more apparent from the follow- 
ing detailed description, which makes reference to the 
figures, in which: 



Fig. 2 shows a more detailed protocol architecture 
of an embodiment of the present invention; 

Fig. 3a shows the protocol architecture of a first pre- 
5 f erred embodiment of the present invention; 

Fig. 3b is an explanatory diagram of the data flow in 
the embodiment of Fig. 3a; 

io Fig. 3c shows the protocol architecture of a second 
preferred embodiment of the present inven- 
tion; 



15 



20 



25 



30 



35 



Fig. 1 shows a basic protocol architecture of the 
present invention; 



Rg. 3d is an explanatory diagram of the data flow in 
the embodiment of Fig. 3c; 

Fig. 4a shows the protocol architecture employed in 
two terminal- devices and an interworklng 
function in accordance with the embodiment 
of Figures 3a and 3b; 

Rg. 4b shows the protocol architecture employed in 
two terminal devices and an interworking 
function in accordance with the embodiment 
of Figures 3c and 3d; 

Rg. 5 is a block diagram explaining a conventional 
multi-media terminal; 

Rg. 6 is a block diagram of a multi-media terminal 
in accordance with an embodiment of the 
present invention; and 

Fig. 7 is an explanatory diagram showing the data 
flow between different protocol layers when 
combining the concept of multimedia multi- 
plexing with the concept of multi-link distri- 
bution over a plurality of physical channels. 



40 [Detailed Description of the Invention] 



[0021 ] Figure 1 shows the basic protocol and layer ar- 
chitecture of the present invention. At a first layer 1, a 
plurality of media streams 12, 13, 14 of different type 
are present, as well as a stream 1 1 of control information 
provided in accordance with the multi-media control pro- 
tocol. An example of such a multi-media control protocol 
is the protocol specified in above mentioned ITU-T Rec- 
ommendation H.245. As will be seen, the control proto- 
col to be used in the context of the present invention will 
preferably have supplementary features that go beyond 
the specification of H.245. This specific implementation 
according to the present invention will therefore be re- 
ferred to as H.245*. Naturally, more than three media 
streams can be present, and more than three different 
types of media. It is equally well possible to have more 
than one stream of the same type. 
[0022] The streams 11, 12, 13, 14 of layer 1 are 
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passed down to lower layers. Among these lower layers, 
but not necessarily directly below layer 1 , is a data dis- 
tribution layer 2. Such a distribution of data onto a plu- 
rality of channels will sometimes also be referred to as 
multi-link distribution. The function of the data distribu- 
tion layer 2 is to distribute the stream of data received 
from above onto channels 31 , 32 provided lower than 
layer 2. The channels may be provided directly below 
layer 2 or intermediate layers may be present. 
[0023] A protocol implementation is provided at the 
second layer 2, which is operable to identify the media 
streams 12, 13, 14 received from above. As already 
mentioned, the first layer 1 is not necessarily provided 
directly above the second layer 2, such that it e.g. pos- 
sible that the second layer 2 receives a continuous bit 
stream in which the media streams are multiplexed. On 
the other hand, it is also possible that the second layer 
2 receives the media streams as separate data streams. 
In any case, the protocol implementation is capable of 
identifying the individual media streams. This can be 
done in any desirable or suitable way. For example, if 
the media streams are passed directly from the first lay- 
er 1 to the second layer 2, then a distinction is straight- 
forward. If the data stream received from above is a con- 
tinuous and multiplexed stream, then it is e.g. possible 
to provide a specific identifier in the higher layer frames 
received by the second layer, such that the second layer 
can read the identifier in orderto identify to which media 
stream the data in the data frame belongs. 
[0024] It is important to note that the term "operable" 
means that the protocol in the second layer 2 does not 
necessarily perform the corresponding function, but is 
able to perform the function. As shall be explained in 
more detail later on, the device and method of the 
present invention preferably comprise different modes 
of operation. 

[0025] Beyond being operable to identify and distin- 
guish the media streams, the protocol implementation 
at the second layer is also capable of taking into account 
the quality of service associated with the channels 31, 
32, such that the placing of a given media stream into a 
given channel may be performed on the basis of the type 
associated with the given media stream and the quality 
of service associated with the given channel. Again it 
should be noted that the protocol implementation at lay- 
er 2 is operable to perform this operation, i.e. it is capa- 
ble doing so. Preferably this operation feature is ar- 
ranged such that it may be turned on or off under the 
control of the application layer. 

[0026] Figure 2 shows an example of a protocol and 
layer stack in which supplementary layers/protocols 
have been added with respect to the general example 
of Figure 1 . More specifically, an application layer 4 pro- 
vides data to the media stream layer 1 , and the streams 
of media 12, 13, 14 and control data 11 are provided to 
a multiplexing layer 5. Additionally, the multiplexing lay- 
er, which encapsulates the data frames or data units re- 
ceived from layer 1 into protocol data units associated 



with a protocol implemented in layer 5, adds an identifier 
to each PDU of the protocol implemented in layer 5, 
such that subsequent layers and protocols are able to 
identify the specific media stream and/or the type of me- 

5 dia being transported, e.g. by parsing the data packets. 
[0027] Then the distribution layer 2 is arranged such 
that in specific modes of operation, it can identify the 
media streams and the type of of each stream coming 
from higher layers on the basis of the above mentioned 

10 identifiers, and is operable to perform the placing of 
each given media stream into a given channel on the 
basis of the type associated with the given media stream 
and the quality of service associated with the given, 
channel. Namely, the channels 31 , 32 provided in layer 

15 3 are controlled on the basis of a protocol implemented 
in layer 6, which is an intermediate layer between layer 
2 and layer 3. The multi-channel control layer 6 adjusts 
and possibly changes the number of channels provided 
in layer 3, and is also operable to change or adjust the 

20 individual settings of each separate channel. The term 
"quality of service 0 is used broadly in the context of the 
present application, and refers to any individual setting 
of transmission parameters or transmission quality, 
where separate channels may have separate settings. 

25 As an example, a different quality of service can consist* 
in a different transmission reliability (e.g. ARQ or no 
ARQ), a different guaranteed maximum delay (e.g. real- 
time or not), or a specific type of coding. Naturally, fur- 
ther different qualities of service are possible, such as 

30 specific types of forward error correction etc. The 
present invention is not restricted to any specific type of 
quality of service. 

[0028] Preferably the implementation of the multime^ 
dia control protocol 11 will provide the instructions that 

35 tell the data distribution layer 2 which streams to place 
in which channel. The various possibilities of e.g. ar- 
ranging different modes for distributing data will be de- 
scribed in more detail further on. 
[0029] The communication device having the proto- 

40 col/layer architecture shown in figures 1 and 2 is pref- 
erably a mobile terminal in a mobile communication sys- 
tem. Figure 3a shows an example of a protocol stack . 
arrangement for a terminal operating in the Universal 
Mobile Telephone Standard (UMTS). An application 400 

45 provides data to a layer 1 00, where the layer 1 00 com- 
prises a control stream 1 01 in accordance with a variant 
of the protocol defined by ITU-T Recommendation H. 
245 (where said variant will be referred to as H.245*), 
an audio stream 1 02, a video stream 1 03 and a data 

50 stream 1 04. These streams are provided to a layer 500, 
which implements ITU-T Recommendation H.223 for 
multiplexing the streams 101, 102, 103 and 104 into a 
single stream. The layer 200 below layer 500 imple- 
ments a multi-link distribution protocol, which can e.g. 

55 be a variation of the known protocol H.226. 

[0030] The implementation of H.245* handles one or 
more of the following tasks: 
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allowing the exchange of audiovisual and data ca- 
pabilities; 

requesting the transmission of a particular audiovis- 
ual or data mode; 

managing the streams (logical channels); 5 
establishing which terminal is the master terminal 
and which is the slave terminal for the purpose of 
managing logical channels; 
carrying various control and indication signals; 
controlling the bit rate of individual logical channels 10 
and the whole multiplex; and 
measuring the round trip time delay from one termi- 
nal to the other and back. 

[0031] Preferably, the implementation of H.245* com- is 
prises all of the features of H.245 according to the ITU- 
T recommendation. According to the invention, It addi- 
tionally comprises the feature of being able to transfer 
information relating to the distribution of specific 
streams onto specific channels having a certain quality 20 
of service, to the multi-link distribution layer 200. In other 
words, it will provide the layer 200 with information on 
how to associate the type of a stream with the quality of 
service in a channel (bearer). Typically, the H.245* im- 
plementation will itself receive corresponding informa- 2S 
tion and instructions from the application 400. This 
transfer of information can occur in-band, i.e. in the (log- 
ical) control channel established by H.245*, where the 
multi-link distributing layer 200 must then be able to read 
the corresponding information out of the control chan- 30 
nel, or can occur separately by way of a dedicated con- 
nection between the module providing the H.245* im- 
plementation and the module providing the multi-link 
distributing implementation 200 (also see correspond- 
ing description in connection with Fig. 6). 35 
[0032] A UMTS multi-call layer 600 is provided, which 
controls the establishment and maintenance of UMTS 
bearers 301 and 302. As in the previous cases, the two 
UMTS bearers (or channels) are only examples, and a 
larger number is possible. 40 
[0033] The multi-link distribution protocol implemen- 
tation in accordance with the present embodiment pref- 
erably comprises all of the features of H.226 described 
in the introduction of the present application, and more 
preferably comprises all features described In ITU-T *s 
Recommendation H.226, which has been incorporated 
by reference, and additionally comprises the capability 
of identifying the media streams 1 02, 1 03 and 1 04 in the 
data received from layer 500 in the form of H.223 
frames, and the capability of performing the placing of so 
a given media stream 1 02, 1 03, 1 04 into a given channel 
301 , 302 on the basis of the type of media in the given 
stream and the quality of service associated with the giv- 
en UMTS bearer. Furthermore, the implementation at 
layer 200 is capable of receiving control information 55 
from the H.245* implementation. As already discussed 
above, this can be done in many different ways, e.g. by 
in-band communication, which means that the multi-link 



distribution implementation is capable of looking into the 
H.245* channel, orby dedicated communication outside 
of the hierarchy shown in Fig. 3a. 
[0034] The identification of the media streams at the 
layer 200 is preferably done on the basis of an index 
contained in the H.223 frames. These indicia are con- 
tained in a multiplexing table and this table indicates the 
type of stream. By reading the H.223 index and perform- 
ing a table look-up, the H.226* layer can determine the 
stream type. 

[0035] The data flow in the example of Fig. 3a is 
shown in Fig. 3b, where only a flow in the direction from 
the application layer to the physical layer is shown. Nat- 
urally the system will also be capable of a corresponding 
return communication from the physical layer to the ap- 
plication layer. Application 400 provides audio (Au), vid- 
eo (VI), and data (Da) information to the H.223 multi- 
plexing implementation 501 . The application 400 also 
provides information on the mode of operation to the H. 
245* implementation 101 , which in turn sends a control 
channel (Co) to layer 501 . Layer 501 then performs the 
multiplexing in accordance with H.223, as e.g. explained 
in the introduction. Fig. 3b shows a second implemen- 
tation in layer 500, namely a rate adaptation implemen- 
tation 502. The rate adaptation (in accordance with 
standard H.223) is only an option, and therefore the cor- 
responding element is only shown as a dashed box. 
Such an optional H.223 rate adaptation will typically be 
included for providing the possibility of integrating the 
present invention into established systems. The arrows 
between 501 and 502 show an example of how the 
streams or logical channels can be mixed, and the thick 
arrow at the bottom of 502 indicates a fully multiplexed 
bit stream. 

[0036] The multi-link distributing layer 200 consists of 
an implementation for demultiplexing the H.223 frames 
received from above, and performing a distribution of 
the streams into available (physical) channels or bear- 
ers on the basis of the type of the stream and the quality 
of service of the channel. The control information com- 
municated by the H.245* implementation to the layer 
201 is indicated by the dashed arrow 800. Layer 201 
outputs streams destined for corresponding UMTS 
bearers (not shown in Fig. 3b), where the example of 
Fig. 3b shows one channel for data and control (Da&Co), 
one for audio (Au) and one for video (Vi). Fig. 3b also 
shows the possibility of performing individual rate adap- 
tation (RA) at a level 202. This is however only an option. 
[0037] As can be seen, the embodiment of Fig. 3a and 
3b is arranged such that the mutti-link distribution (200) 
is provided below the multiplexing function (500). It is 
however also possible to arrange the multiplexing func- 
tion and the distribution function together. This will be 
explained in connection with Figures 3c and 3d. 
[0038] Fig. 3c shows another embodiment, in which 
the functions of multiplexing and multi-link distribution 
are provided in one layer 210. This is reflected by the 
diagram of fig. 3d, which shows the flow of data in the 
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stack of Fig. 3c. As can be seen in comparison with Fig. 
3b, the logical channels Co, Au, Vi and Da are fed to the 
multiplexing (e.g. in accordance with H.223) and multi- 
link distributing layer 203. The rate adaptation 202 for 
individual channels is again shown, although it is only 
an option. Again, the control connection between H. 
245* and 203 is indicated by the dashed arrow 800. 
[0039] In both of the above cases, the H.245* layer 
contains some logic to decide whether a new channel 
is to be allocated, and if yes, which channel (i.e. which 
quality of service). Preferably, the H.245* layer will also 
provide instructions to the layer 600 for managing the 
channels, such that the H.245* implementation can in- 
dicate if a new (physical) channel is to be opened, which 
quality of service is to be associated with said new chan- 
nel, and then also instruct the multi-link distributing layer 
to place a certain stream or certain streams into the such 
created new channel. Generally, the H.245* itself will re- 
spond to instructions and information from the applica- 
tion layer when performing such control. 
[0040] According to a preferred embodiment, the pro- 
tocol implementation at the data distribution layer 2 or 
200 is capable of operating in one or more of a plurality 
of modes (such a mode may e.g. be directly instructed 
by the application layer, as indicated in Fig. 3b and 3d). 
According to a first mode, the data stream received from 
a higher layer is placed into one or more of the channels 
or bearers irrespective of the type of media. In other 
words, the layer 2, 200 will then use other criteria for 
distributing the data, e.g. the criteria known from con- 
ventional recommendation H.226. More specifically, 
with respect to the example of figure 3, the inventive pro- 
tocol implementation in layer 200 will operate like a con- 
ventional H.226 implementation in this mode. Prefera- 
bly, the mode of the protocol implementation in layer 2, 
200 is coupled to a mode of operation in the multi-chan- 
nel control layer 6, 600. Namely, at the same time that 
the protocol implementation in layer 200 operates as de- 
scribed above, the multi-call control layer 6, 600 should 
operate such that additional channels or bearers are on- 
ly added as is necessary for bandwidth requirements. 
As a consequence, this mode of operation of the proto- 
col implementations in layers 2, 200 and 6, 600 corre- 
sponds to a mode of optimized bandwidth usage. 
[0041] According to a second mode of operation, the 
layer 2, 200 should combine two of the data streams into 
one channel or bearer (or one set of channels or bear- 
ers, all having the same quality of service) and place a 
third stream into one or more channels having a different 
quality of service. As an example, audio and video 
streams can be placed into one or more channels or 
bearers having the same quality of service, whereas the 
data stream 104 is placed into one or more channels 
having a different quality of service. Namely, the audio 
and video streams can be placed into a real-time chan- 
nel or bearer, whereas the data stream can be placed 
into an error-free channel or bearer. This second mode 
is an intermediate mode between the optimization of the 



band-width and the quality of service. Or, as indicated 
in Fig. 3b and 3d, the control stream and data stream 
can be placed into an error-free channel (e.g. with ARQ) 
and the audio and video are placed into respective real- 

5 time bearers. 

[0042] A third mode of operation comprises placing 
each media stream 1 02, 1 03, 1 04 into one or more chan- 
nels or bearers of a dedicated quality of service. In other 
words, the audio stream 1 02 is associated with a unique 

10 bearer, the video stream 1 03 is associated with a unique 
bearer, the data stream 1 04 is associated with a unique 
bearer, and the control stream is associated with a 
unique bearer. For example, the audio stream can be 
placed into a bearer that has a coding optimized , for 

15 speech, while the video stream is placed into a simple 
transparent bearer. 

[0043] It may be noted that the bearer or channel for 
the audio stream and the bearer or channel for the video 
stream may have different qualities of service. Although 

20 this can lead to a certain shift between the two streams, 
the problem of precise synchronization between video 
and audio (such as lip-synchronization) is handled at the 
application layer, and can be solved by the suitable use 
of buffers and similar means. More precisely, it is e.g. 

25 possible that the multi-link distribution layer or the con^ 
trol layer (H.245*) determines the shift, and provides 
corresponding information to the application layer and/ 
or introduce some delay in one or more of the media 
streams in order to compensate the shift. 

30 [0044] Namely, in accordance with this third mode, 
which is a mode to optimize the quality of service, it can 
be advantageous to provide different transmission set- 
tings for the channel carrying the video stream than for 
the channel carrying the audio stream, as the audio 

35 stream and video stream have their own specific and 
individual problems and characteristics. This third mode 
is therefore a mode for optimizing the quality of service. 
[0045] The three above described modes are only ex- 
amples, and many more modes can be provided. 

40 [0046] Figure 6 shows a block diagram of a UMTS ter- 
minal 700 that embodies the present invention. As can 
be seen, the elements 71 to 79 are the same as in the 
conventional terminal of Figure 5, such that a repeated 
description is not necessary. However, terminal 700 

^5 comprises a multi-link distributing interface 800 and a 
corresponding interface control 801 . Namely, as can be 
seen in Figures 3 and 6, the multiplexer/demultiplexer 
79 operates in accordance with ITU-T Recommendation 
H.223, and the interface 800 carries the layer 200 in 

50 which the multi-link distributing protocol of the invention 
is implemented. As a consequence, the link 810 shown 
in Figure 6 carries the plurality of bearers 301 , 302, and 
the interface 800 performs the placing of media data 
streams into the bearers as explained above. Further- 

55 more, the UMTS multi-call control (of layer 600 in figure 
3) is also handled by the interface 800 under control of 
the system control 74 via the interface control 801 . 
[0047] The example of Fig. 6 shows a direct connec- 
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tion between the control protocol implementation 78 and 
the interface control 801 . Namely, this represents the 
possibility of the H.245* implementation to send instruc- 
tions and information to the multi-link distributing layer. 
More precisely, the system control 74 (it may be noted 5 
that typically the elements 73 and 74 will be provided in 
one physical unit, namely in a processor, such that there 
will be interaction between the two) can e.g. instruct the 
control protocol 78 on the mode of operation. The con- 
trol protocol 78 can then decide when a new (logical) 10 
channel is to be opened and instruct the interface control 
801 whether the stream in the new logical channel 
should be multiplexed with one or more existing stream 
or a new channel should be opened for the stream in 
the new logical channel. The interface control 801 can 15 
decide on its own how many channels are required for 
the streams belonging together. The Interface control 
801 may have to ask the system control 74 whether it is 
allowed to open a new channel. As an alternative, such 
information could also be provided to the interface con- 20 
trot 801 at the beginning of a session. 
[0048] In an alternative embodiment (not shown), 
which corresponds to the arrangement shown in Figures 
3c and 3d, the multiplexer/demultiplexer 79 and the in- 
terface 800 are unified into a single element that fulfills 25 
the tasks of identifying the media streams and multiplex- 
ing and placing the streams into the plurality of bearers. 
[0049] As can be seen, the entire process occurs un- 
der control of the system control 74, which sends com- 
mands to the control protocol unit 78 and the interface so 
control 801 , to thereby control the operations of layers 
1 00, 200, 600 in figure 3 and layers 1 , 2 and 6 in figure 2. 
[0050] In the above embodiments, the communica- 
tion device of the present invention was described as 
being a mobile terminal in a mobile communication sys- 35 
tern. However, the communication device of the present 
invention can be any communication device involved in 
the distribution of data over a plurality of channels, such 
as an interworking function or interworking device pro- 
vided between two different communication networks, 40 
e.g. between a mobile communication network and an- 
other mobile communication network or a fixed network. 
Examples of this are shown in figures 4a and 4b. Figure 
4a corresponds to the arrangement shown in Figures 3a 
and 3b, and Figure 4b corresponds to the arrangement 45 
shown in Figures 3c and 3d. 

[0051] As can be seen, the mobile terminal on the left 
hand side of Fig. 4a is arranged as described in connec- 
tion with figures 3a and 3b, such that a repeated descrip- 
tion is not necessary. The right hand side shows a ter- so 
minal of a different network, and between these two ter- 
minals an interworking function (IWF) operates. In the 
example of figure 4a, the mobile communication is a 
UMTS network. The other network can be of any desired 
type, for example an ISDN network or another mobile 55 
network. 

[0052] As can be seen, the UMTS IWF has a relay 
layer. On the UMTS side, the streams are controlled in 



accordance with H.245* described above, and the other 
network is shown as being controlled in accordance with 
H.245. Then the UMTS side has a layer 505, which con- 
stitutes the peer to layer 500 in the mobile terminal. In 
other words, it fulfills the corresponding functions. The 
layer 205 is the peer to layer 201 in the terminal. This 
layer therefore operates precisely like the above de- 
scribed layer 201. It may be added that when one of 
these multi-link distributing layers 201 or 205 acts as a 
receiver, it will perform the inverse operation, namely 
take the information out of the (physical) channels and 
rebuild the H.223 frames, which are then passed up- 
wards to the respective demultiplexing layer 500 or 505. 
[0053] In the example of figure 4a, the other network 
operates in accordance with standard H.226. The other 
network is furthermore shown as having a multi-link fea- 
ture, where the channels are indicated as circuits, as 
this is e.g. the case in an IDSN network, where the cir- 
cuits could be B-channels. 

[0054] The unidirectional streams are independent of 
one another, i.e. the streams in the uplink direction are 
independent of the streams in the downlink direction 
(see arrows in figure 4). This means that the operation 
of the inventive multi-link distributing implementation for 
the uplink can be performed without any support from 
either the UMTS IWF or the terminal at the other end of 
the connection. In other words, the system control 74 
(see figure 6) performs its control operation independ- 
ently of the IWF or other terminal, based on choices 
made by the user of the terminal and/or on suitable con- 
trol software for communications operations. 
[0055] It is generally preferable that the mode of op- 
eration of the multi-link distributing protocol implemen- 
tation be chosen by the mobile terminal. In the case of 
a downlink connection (from the UMTS IWF to the mo- 
bile terminal) this means that the mobile terminal has to 
signal the preferred mode to the UMTS IWF at an ap- 
propriate time. This can e.g. be done during the link set- 
up between the mobile terminal and the UMTS IWF, but 
can also be handled dynamically in the course of a ses- 
sion. The signaling can be done in any suitable way, for 
example in a control channel arranged forthe exchange 
of control information between a mobile terminal and the 
base station, or in the H.245* channel. 
[0056] Although the present invention has been de- 
scribed on the basis of preferred embodiments, it shall 
be understood that the invention is by no means restrict- 
ed to these embodiments, but is defined by the scope 
of the appended claims. Also, reference numerals in the 
claims serve the purpose of making claims easier to un- 
derstand, and do not restrict the scope of the claims. 



Claims 

1 . Communication device (700) comprising a plurality 
of protocol implementations layered in a stack, said 
stack comprising: 
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2. 



6. 



a first protocol implementation (1 1 ; 1 01 ) provid- 
ed at a first layer (1 ; 1 00) that receives data and 
is arranged to process said received data such 
that it is associated with one or more of a plu- 
rality of media data streams (12, 13, 14; 102, 
1 03, 1 04) , each media stream being associated 
with a type, and to pass the processed data to 
a second layer (2; 5; 500) lower than said first 
layer (1; 100), 

a second protocol implementation provided at 
a second layer (2; 200) lower than said first lay- 
er (1; 100), said second protocol implementa- 
tion being operable to identify the media data 
streams (12, 13, 14; 102, 103, 104) in the data 
it receives from a higher layer, and to place said 
one or more media data streams (12, 13, 14; 
102, 103, 104) into one or more channels (31, 
32; 301 , 302), said channels (31 , 32; 301 , 302) 
being provided at a third layer (3; 300) lower 
than said second layer (2; 200), where any two 
different channels of said one or more channels 
(31 , 32; 301 , 302) are adjustable to be associ- 
ated with different qualities of service, and 
where said second protocol implementation is 
operable to perform the placing of a given me- 
dia stream into a given channel on the basis of 
the type associated with said given media 
stream and the quality of service associated 
with said given channel. 

Communication device according to claim 1 , char- 
acterized by being a mobile station (700) in a mo- 
bile communication network (900). 

Communication device according to claim 1 or 2, 
characterized in that said first protocol implemen- 
tation comprises a multimedia control protocol (H. 
245*), and receives data from an application layer 
(4; 400). 

Communication device according to claim 3, char- 
acterized in that a third protocol implementation 
(H.223) is interposed at a fourth layer (5; 500) be- 
tween said first and second layers, said third proto- 
col implementation (H.223) being arranged to mul- 
tiplex the media streams (12, 13, 14; 102, 103, 104) 
received from said first layer (1; 1 00) into a single 
stream, and passing said single stream down to 
said second layer (2; 200). 

Communication device according to claim 1 , char- 
acterized by being an interworking device between 
a first communication network and a second com- 
munication network. 

Communication device according to claim 5, char- 
acterized in that at least said first communication 



network is a mobile communication network (900). 

7. Communication device according to claim 5 or 6, 
characterized in that said first protocol implemen- 
tation implements a relay function. 

8. Communication device according to one of claims 
1 to 7, characterized in that the type each media 
data stream (12, 13, 14; 102, 103, 104) is associat- 
ed with identifies one or more of.at least three dif- 
ferent kinds of media, and said second protocol im- 
plementation is operable to perform said placing of 
media streams into channels in accordance with 
two or more of at least three different modes, where 

a first mode comprises placing said data re- 
ceived from a higher layer into one or more of 
said channels (31 , 32; 301 , 302) Irrespective of 
the type, 

a second mode comprises placing a media 
stream of a first type (audio) and a media 
stream of a second type (video) into one or 
more channels (31, 32; 301, 302) having the. 
same quality of service, while a media stream 
of a third type (data) is placed into one or more 
channels (31 , 32; 301 , 302) having a different 
quality of service than the one or more channels 
for the first and second type, and 

a third mode comprises placing each media 
stream of a given type into a one or more chan- 
nels of a dedicated quality of service. 



35 9. Communication device according to claim 8 as de- 
pendent on one of claims 5 to 7, characterized in 
that said interworking device receives instructions 
regarding the mode or modes of operation from a 
terminal device in said first communication network. 
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10. Communication device according to one of claims 
1 to 9, characterized in that said channels (31 , 32; 
301 , 302) are established in accordance with the 
multi-call function provided by the universal mobile 
telephone standard (UMTS) and the establishment 
and maintenance of said channels (12, 13, 14; 102, 
103, 104) is controlled by a control layer (6; 600) 
provided between said second layer (2; 200) and 
said third layer (3; 300). 

11. Method of distributing data over a plurality of chan- 
nels (31 , 32; 301 . 302), where any two different 
channels of said plurality of channels (31 , 32; 301 , 
302) are adjustable to be associated with different 
qualities of service, and where said data to be dis- 
tributed comprises a plurality of media data streams 
(12, 13, 14; 102, 103, 104), each media stream be- 
ing associated with a type of media, comprising the 
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steps of 

identifying the media data streams (12, 13,14; 
102, 103, 104) in said data to be distributed, 
and s 

placing a given media stream into a given chan- 
nel on the basis of the type of media in said giv- 
en media stream and the quality of service as- 
sociated with said given channel. 1 o 

12. Method according to claim 11, characterized In 
that each media data stream (12, 13, 14; 102, 103, 
1 04) is associated with one of at least three different 
types of media, and said step of placing media 15 
streams into channels comprises placing a media 
stream of a first type of media (audio) and a media 
stream of a second type of media (video) Into one 
or more channels (31, 32; 301, 302) having the 
same quality of service, while a media stream of a 20 
third type of media (data) is placed into one or more 
channels (31 , 32; 301 , 302) having a different qual- 
ity of service than the one or more channels for the 
first and second type of media. 



13. Method according to claim 12, characterized in 
that said first type of media is audio, said second 
type of media is video, and said third type of media 
is data. 



25 



30 



14. Method according to claim 11, characterized in 
that said step of placing media streams into chan- 
nels comprises placing each media stream of a giv- 
en type of media into a one or more channels of a 
dedicated quality of service. 35 
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